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Abstract 

This  note  provides  a  completeness  result  on  the  compressed  modes  introduced  in 
[7,  8] .  We  prove  the  fact  that  for  an  unbounded  Hermitian  operator,  the  sub-eigenspace 
of  spanned  by  the  first  M  eigenfunctions  can  be  approximated  by  first  N  compressed 
modes  with  improvable  accuracy  as  N  increases,  for  any  fixed  regularization  parameter 
A 

1  Introduction 

In  [7],  the  authors  introduce  a  novel  framework  for  obtaining  spatially  localized  (“sparse”) 
solutions  to  a  class  of  problems  in  mathematical  physics  that  can  be  formulated  as  varia¬ 
tional  problems.  The  method  is  to  add  an  L 1  regularization  term  in  the  variational  problem, 
which  penalizes  the  L 1  norm  of  the  solution.  This  yields  solutions  called  the  “compressed 
modes”.  Numerical  evidences  in  [7,  8]  show  that  compressed  modes  have  compact  support. 
In  recent  work  [1],  the  author  provides  some  interesting  theoretical  analysis  of  compressed 
modes.  It  is  shown  that  as  the  L 1  regularization  term  in  the  variational  problem  vanishes, 
the  compressive  modes  converge  in  the  L2  norm  to  a  unitary  transformation  of  eigenfunc¬ 
tions  of  the  original  Hamiltonian.  The  idea  of  obtaining  sparse  solutions  by  i1  minimization 
can  also  be  found  in  other  work  such  as  [5,  3,  2,  4,  9].  The  regularization  parameter  for 
the  L 1  term  is  used  to  balance  between  the  consistency  with  the  original  problem  and  the 
sparsity  of  the  solution. 

In  [7]  the  authors  consider  the  time-independent  Schrodinger’s  equation  for  the  inde¬ 
pendent  particles,  where  the  Hamiltonian  is  defined  as 

H  =  -\  A  +  V(x),  (1) 
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which  is  an  unbounded  positive-definite  Hermitian  operator.  The  variational  problem  for 
the  ground  state  energy  of  N  particles  is  proposed  as 

N 

Eo  =  mmy2{(j)j,H<j)j)  s.t.  {(/>j,<j>k)  =  8jk-  (2) 

; 

3= 1 

The  solutions  <f?7v  =  {4>i}fLi  are  a  set  of  orthonormal  eigenfunctions  corresponding  to 
eigenvalues  {Aj}^1,  where  the  eigenvalues  are  arranged  in  non-decreasing  order.  Any 
unitary  transformation  of  also  gives  a  set  of  solutions  to  this  variational  problem. 

In  history,  in  order  to  obtain  localized  solutions  to  this  problem,  people  choose  the  the 
solutions  to  be  some  unitary  transformation  of  the  eigenfunctions,  such  that  the  solutions 
are  “maximally  localized”,  which  are  called  the  localized  Wannier  functions  [10,  6]. 

Different  from  this  approach,  the  compressed  modes  are  constructed  by  solving  a  new 
variational  problem 


E  =  min£  (  —  IV’jli  +  s.t.  (ipj,ipk)  =  Sjk,  (3) 

^  “[  V/1  / 

where  the  minimizers  \EW  =  {V’jljLi  are  called  the  compressed  modes  for  the  variational 
problem  (2),  and  \ipj\i  =  f(}  \rip-j(x)\  dx.  The  compressed  modes  are  shown  to  be 

more  localized  than  the  Wannier  functions.  But  unlike  Wannier  functions,  they  cannot  be 
obtained  by  a  unitary  transformation  of  the  eigenfunctions  of  H.  We  note  that  in  [1]  it 
was  shown  that  for  fixed  N,  a  unitary  transformation  of  the  compressed  modes  and  their 
associated  eigenvalues  converge  as  /x  approaches  infinity  to  their  limiting  values,  which  are 
eigenfunctions  and  eigenvalues  of  H.  In  this  paper  we  answer  a  different  and  important 
question,  namely  for  fixed  /i,  under  some  unitary  transformation,  these  compressed  modes 
can  approximate  the  eigenfunctions  in  a  systematically  improved  manner  as  N  increases. 
This  result  characterizes  the  closeness  between  the  space  spanned  by  the  compressed  modes 
and  the  true  eigen  space. 

The  rest  of  the  paper  is  organized  as  follows.  In  Section  2,  we  formally  describe  the 
main  result.  In  Section  3,  we  state  the  key  lemmas  that  would  be  used  in  the  proof  of  the 
main  result,  which  is  given  in  Section  4.  The  proofs  to  the  lemmas  are  put  in  the  appendix. 
In  the  end,  we  make  some  concluding  remarks. 

2  Main  result 

In  general,  let  H  be  an  unbounded  positive-definite  Hermitian  operator.  It  is  well  known 
that  H  has  discrete  eigenvalues  approaching  infinity,  and  the  corresponding  eigen-functions 
can  form  a  set  of  orthonormal  basis  in  L2(H),  where  H  is  the  domain  in  consideration.  We 
assume  that  D  is  bounded.  Denote  A i  the  eigenvalues  for  H  arranged  in  ascending  order, 


2 


and  (j>i  be  the  corresponding  orthonormal  eigenfunctions.  The  first  N  compressed  modes 
associated  with  H  refer  to  the  solution  to  the  variational  problem  (3).  We  claim  the 
following  result: 

Theorem  1.  Given  any  fixed  parameter  p,  the  first  N  compressed  modes  up  to  an  unitary 
transformation,  denoted  by  {£1, . . .  ,  £at},  satisfies 


-6II2< 


2  NCn 

p{^N+l  —  K)  ’ 


for  i  =  1, . . . ,  N,  where  Cq  is  a  constant  depending  only  on  17. 
If  the  eigenvalues  {A.;}  satisfies 


l 

lim  —  =  0, 

i— >oo  Xi 

then  for  fixed  integer  M  <  N  and  i  =  1, . . . ,  M , 


~  &II2  < 


2  NCn 

p(^N+i  —  Am) 


As  a  result, 

uniformly  for  i  =  1, . . . ,  M. 


lim 

TV— >-00 


&II2  =  0 


(5) 

(6) 
(7) 


Remark  1.  As  an  example,  let  H  =  —  and  17  be  a  finite  interval,  then  the  eigenvalues 
satisfy  (5),  in  which  the  above  theorem  holds. 


3  Some  useful  lemmas 

For  the  positive-definite  unbounded  Hermitian  operator  H,  the  set  of  eigenfunctions 
is  an  orthonormal  basis  in  L2(Q)  up  to  a  normalization.  Let  {ifi, . . . ,  Vt/v}  be  a  set  of 
orthonormal  functions  in  L2(Q).  In  particular,  they  can  be  the  first  N  compressed  modes. 
Then  each  fij  has  an  linear  expansion 

OO 

Vh  =  (8) 

i=l 

where  ap  are  the  coordinates  of  ifj  under  the  basis 
By  the  orthogonality  of  fjj’s,  we  have 

OO 

^  y  dji&ki  A//,- ■  (9) 

i= 1 
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where  5jk  is  the  Dirac  delta  function.  A  special  case  is  that 


E  M2  =  (10) 

1=1 


for  j  =  1, ...  ,N. 

Our  first  lemma  is  concerned  with  the  summation  of  \dji\2  in  the  first  dimension,  which 
is  also  given  as  Lemma  3.1  in  [1], 

Lemma  1.  In  the  previous  notations, 


N 

£ 

3  =  1 


V*l  — 


<  1, 


(11) 


fori  =  1,2,.... 

Proof.  See  the  appendix.  □ 

In  the  next  lemma,  we  give  an  estimate  of  the  error  of  the  approximate  energy  in  (3) 
to  the  true  energy  given  by  (2). 

Lemma  2. 

E0<E<E0  +  ^,  (12) 

/i 

where  E  and  Eq  are  defined  in  (3)  and  (2). 

Proof.  See  the  appendix.  □ 

Remark  2.  In  the  definition  of  the  variational  problem  (3),  by  replacing  the  L 1  term  by 
any  functional  bounded  by  L2  norm,  the  energy  E  still  satisfies  upper  estimate 

E  <  Eq  +  CfiN/ n,  (13) 

for  some  constant  Cn  depending  only  on  Q. 

A  corollary  of  this  lemma,  also  shown  in  [1],  is  that  if  p.  — >•  oo,  E  — >  Eq,  which  shows 
the  consistency  of  the  variational  form  (3)  with  (2) . 

The  more  important  lemma,  as  follows,  gives  an  sharper  lower  bound  of  E  than  that 
in  Lemma  2. 

Lemma  3.  Let  the  first  N  compressed  modes  be  ipi, . . .  Use  the  notation  in  (8)  and 

denote 

N 

ai  =  'y  ^  |ciji|  j  (i4) 

3=1 
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fori  =  1,2,.... 

Then  we  have 

N  N  N  oo 

^2('ipk,H4’k)  =  ^2\i  +  ^2(l  -  a.i){XN+i  -  \i)  +  ^2  ai(Xi-XN+1).  (15) 

k=  1  2=1  2=  1  i=N-\-l 

As  a  consequence,  a  lower  bound,  for  E  is  given  by 

N 

E  >  Eq  +  ^"^(1  —  Oj)( Aat+i  —  A*).  (16) 

2=1 

Proof.  Proof  by  standard  calculation.  Given  in  the  appendix.  □ 


4  Proof  of  the  main  theorem 


By  (8),  the  compressed  modes  tfj  has  coordinates  {aji}fTl  under  the  basis  Under 

an  unitary  transformation  U  £  CNxN ,  {f>j}2=  i  are  transformed  to  {CjljLr,  where  each  fj 
has  coordinates  {bji}fT1  under  the  basis  More  exactly, 


/  an  \ 

(  hi  \ 

a2i 

b2i 

u 

— 

\  aNi  )  \  bm  ) 


for  i  =  1 , . . . ,  and 

OO 

fj  =  22  bjifa, 

2=1 

for  j  =  1, . . . ,  IV.  By  QR  decomposition,  there  exists  such  an  U  that 


(17) 


(18) 


/bn 

b\2  ■  ■ 

b\N  ^ 

5'21 

622  •  • 

b2N 

\bm 

bN2  •  • 

■  biSTN  J 

(19) 


is  upper  triangular,  that  is,  bji  =  0  for  i  <  j,  and  bjj  are  non-negative  real  numbers. 
Because  unitary  transformation  preserves  the  length  of  the  vector, 


22 M2 


3= 1 


N 

El  I2  — 

\&ji\  — 

3= 1 


(20) 
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Since  {Cj  }^=i  are  orthonormal, 


(21) 


2=1 


Because  bji  =  0  for  i  <  j  <  N,  for  %  =  1, . . . ,  N,  we  rewrite  (20)  as 


and  for  j  =  1, . . . ,  N,  (21)  becomes 


Next  we  show  that 


for  i  =  1, . . . ,  N. 

By  (22), 


From  (23)  we  know 


Therefore,  for  i  =  1, . . . ,  N 


3= 1 


£IM2  =  i- 


‘=3 


IM 2  >  ^cij  -  (z-  1). 

3= 1 


2—1 

IM2  =  a*  -  XI  IM2> 


2—1 

IM2  <  1  -  ^2  I bjk | 2 • 

k=j 


(22) 


(23) 


(24) 


(25) 


(26) 


IM2  >  Oi-E  I1-  EN2 

3= 1  V  k=j  / 

=  o?  —  (i  —  1)  +  E  E  IMP 

1=1  k=j 

=  i)  +  E  E  IM2 

fe=i  i=i 
2—1 

=  a*  -  (z  -  1)  +  J]  ak 
k= 1 

=  E%-  (*  -  !)• 

fc=i 


(27) 
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By  Lemma  2  and  3,  we  have  an  estimate  of  a*  as  defined  in  (14)  as 


N 


YM  —  <r)(Aat+i  —  A*)  < 


i= 1 


NCn 


where  a*  <  1  as  proved  in  Lemma  1.  Because  {A*}  are  non-decreasing, 

NCn 


k= 1 


m(Aat+i  —  A*)  ’ 

which  is  combined  with  (27)  to  give 


iVCn 


m(Atv+i  —  Aj)  ’ 

for  i  =  1, . . . ,  N.  By  our  construction,  bu  are  non- negative  real  numbers,  so 

Now  we  calculate  \\(f>i  —  6 111-  We  note  (18)  and  write 


^3  £?ll  — 


(bjj  l)(j)j  +  bji4>i 


Since  are  orthonormal, 


II2  =  ( bjj~1)2+  E  \bji\2 

i=l,iy^j 

=  (6jj-l)2  +  l-tJ,. 

<  1  -  +  1  -  6?,. 

<  2NCn 

—  fi(  Ajv+i— Aj)' 


33 


(28) 


(29) 


(30) 


(31) 


(32) 


(33) 


From  this  inequality  we  can  conclude  that  for  a  fixed  n  >  0  and  integer  M,  if  eigenvalues 
of  H  satisfy  (5),  then  for  j  =  1, . . . ,  M,  || (f>j  —  £j||2  converges  uniformly  to  0  as  N  — >  oo. 


5  Conclusion 

In  this  short  note,  we  prove  a  completeness  theorem  on  the  compressed  modes.  As  discussed 
in  Remark  2,  the  result  in  Theorem  1  still  holds,  up  to  a  change  in  the  constant  coefficient, 
if  the  L 1  term  is  replaced  by  any  functional  bounded  by  L2  norm  in  the  variational  problem 

(3). 
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By  changing  the  variational  formulation  (3)  to 


N  *  1 

E  =  min H'lpj)  +  -|^jv|i  s.t.  (ipj,ipk)  =  &jk, 

'Vn  — ;  U 

J=1 

where  |  'f'iv  1 1  denotes  the  1-norm  of  the  matrix,  we  can  improve  the  estimate  of 
to 

U‘  MAjv+i-A,)' 

In  this  case  the  requirement  (5)  on  the  eigenvalues  can  be  relaxed  to 


(34) 


(35) 


lim  Xi  =  oo,  (36) 

i— >oo 

and  || 4>i  —  Hi  converges  uniformly  to  0  as  N  goes  to  infinity,  for  i  =  1 ,M  with  M 
fixed. 


A  Proof  of  the  lemmas 

A.l  Proof  of  Lemma  1 

The  proof  of  this  lemma  is  also  given  in  [1],  and  here  we  give  a  different  one.  By  (9)  (the 
orthogonality  condition),  for  any  e  >  0  and  fixed  N,  there  exists  n  >  N  such  that 


An  — 


satisfies 


£' 

i= 1 


/  Oil 

012  •  • 

Ol n  ^ 

021 

022  '  ' 

02  n 

\a>Ni 

OJV2  •  • 

0  A  i:  J 

s|s 

Q’ji&ki 

<  e/N,  for  j  /  k. 

;ian  matrix  B  = 

(1  +  e)I 

(37) 


(38) 


We  note  that 


n 


£  ajia*ki 
1=1 


(i  +  0 


£  M2 


i=  1 


if  j  +  k 
if  j  =  k 


Bjj  >  e  and 


N 

y  ]  \Bjk\  <  e> 

k^j,k=l 

8 


(39) 


(40) 


so  B  is  a  diagonal  dominant  Hermitian  matrix  with  positive  diagonal  entries,  hence  it  is 
positive-definite.  Also  (1  +  e)I  —  A*An  is  an  n  x  n  positive-definite  matrix,  so  its  diagonal 
entries  are  all  positive  real  numbers.  Therefore,  the  diagonal  entries  of  A*  An  are  all  less 
than  1  +  e,  that  is, 

N 

|Ojj|2  <  1  +  e  for  i  =  1, -  (41) 

1= i 

N 

Since  ^  \aji\2  is  independent  of  e,  we  let  e  — >  0  and  obtain 
1= 1 

N 

|ojj|2  <  1  for  *  =  1, ... .  (42) 

l=i 


(43) 


A. 2  Proof  of  Lemma  2 

Let  4'jv  =  {^-}f=i  be  the  minimizer  of  (3),  then 

N  N 

E  >  Y'WjMj)  >  =  **>• 

l=i  ">A  l=i 

For  any  V’  E  L2(P)  with  ||-0||  =  1, 

J  M  dx  <  J  J  VWM2  +  — 7=  dx  = 

f2  n  v 

The  equality  holds  when  |^;|  =  l —  a.e.  in  Q.  Then 

Vlnl 

N  i  A  N  ,  N  i  n  fin\ 

E  =  minE(-^|i  +  (V’l,^l))  <  minV(^,^)+V-v^  =  -Eo  H - — - '•  (45) 

/U  Vjv  “J  /i  /i 


(44) 


l=i 
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A. 3  Proof  of  Lemma  3 

We  note  (8)  and  Hfa  =  A j</>j, 


N 

3= 1 
N  oo 

=  EE  \aki\2\. 

k=  1 
oo  N 

=  EE  \aki\2\ 

2= 1  /c=l 

AT  oo 

=  ^2^2  “1“  ^2^2 
2=1  2=A^+1 

AT  AT 


N  N  N  oo 

=  EE  +  El  (i —  ai)(^N  —  Aj)  +  EE  (°i —  i)Aat  +  EE  a*(A 

2=1  2=1  2=1  2=7V+1 

N  N  oo  / 

=  EE  A  +  EE  (! —  ai)(\N  —  A*)  +  EE  ai{\  —  Aat)  +  ( , 

i=l  i=l  i=JV+l  Vi 

where  a*  is  defined  in  (14).  Also  we  note  that 


EE  ai 

=  1 


OO 

—  Ajv)  +  EE 

i=N+l 

^  Aat  -  A^Aat, 

(46) 


oo  oo  AT  N  oo 

Y1 ai  =  Ull  m2  =  5Z  5Z  m2  =  ^ 

2=1  2=1  j=  1  J  =  1  2=1 

where  we  use  the  fact  (10).  Then  following  (46)  we  have 

N  N  N  oo 

E  ^  (Vh'  j  )  —  E  '  A  T  E  ®i)  ( AjV  Aj)  +  E  '  ®i  ( Aj  A  at). 

J  =  1  2=1  2=1  2=7V+1 


(47) 


(48) 
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